Pandas Profiling Report

Dataset statistics

Number of variables	23
Number of observations	140051
Missing cells	136020
Missing cells (%)	4.2%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	24.6 MiB
Average record size in memory	184.0 B

Variable types

NUM	19
CAT	4

Warnings

`AREA_TITLE` has a high cardinality: 396 distinct values	High cardinality
`PRIM_STATE` has a high cardinality: 52 distinct values	High cardinality
`OCC_TITLE` has a high cardinality: 808 distinct values	High cardinality
`A_MEAN` is highly correlated with `H_MEAN` and 8 other fields	High correlation
`H_MEAN` is highly correlated with `A_MEAN` and 8 other fields	High correlation
`H_PCT25` is highly correlated with `H_MEAN` and 8 other fields	High correlation
`H_PCT10` is highly correlated with `H_PCT25` and 4 other fields	High correlation
`H_MEDIAN` is highly correlated with `H_MEAN` and 10 other fields	High correlation
`H_PCT75` is highly correlated with `H_MEAN` and 8 other fields	High correlation
`H_PCT90` is highly correlated with `H_MEAN` and 6 other fields	High correlation
`A_PCT10` is highly correlated with `H_PCT10` and 4 other fields	High correlation
`A_PCT25` is highly correlated with `H_MEAN` and 8 other fields	High correlation
`A_MEDIAN` is highly correlated with `H_MEAN` and 10 other fields	High correlation
`A_PCT75` is highly correlated with `H_MEAN` and 8 other fields	High correlation
`A_PCT90` is highly correlated with `H_MEAN` and 6 other fields	High correlation
`TOT_EMP` has 11658 (8.3%) missing values	Missing
`EMP_PRSE` has 11658 (8.3%) missing values	Missing
`JOBS_1000` has 11658 (8.3%) missing values	Missing
`LOC_QUOTIENT` has 11658 (8.3%) missing values	Missing
`H_MEAN` has 9284 (6.6%) missing values	Missing
`A_MEAN` has 2848 (2.0%) missing values	Missing
`MEAN_PRSE` has 2976 (2.1%) missing values	Missing
`H_PCT10` has 9305 (6.6%) missing values	Missing
`H_PCT25` has 9543 (6.8%) missing values	Missing
`H_MEDIAN` has 10152 (7.2%) missing values	Missing
`H_PCT75` has 10932 (7.8%) missing values	Missing
`H_PCT90` has 13146 (9.4%) missing values	Missing
`A_PCT10` has 2869 (2.0%) missing values	Missing
`A_PCT25` has 3108 (2.2%) missing values	Missing
`A_MEDIAN` has 3723 (2.7%) missing values	Missing
`A_PCT75` has 4546 (3.2%) missing values	Missing
`A_PCT90` has 6956 (5.0%) missing values	Missing
`TOT_EMP` is highly skewed (γ1 = 99.04921957)	Skewed
`LOC_QUOTIENT` is highly skewed (γ1 = 39.84715828)	Skewed
`EMP_PRSE` has 2729 (1.9%) zeros	Zeros

Reproduction

Analysis started	2021-10-31 19:41:49.669632
Analysis finished	2021-10-31 19:44:10.667085
Duration	2 minutes and 21 seconds
Software version	pandas-profiling v2.9.0
Download configuration	config.yaml

AREA
Real number (ℝ_≥0)

Distinct	396
Distinct (%)	0.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	32514.37376
Minimum	10180
Maximum	79600
Zeros	0
Zeros (%)	0.0%
Memory size	1.1 MiB

Quantile statistics

Minimum	10180
5-th percentile	12100
Q1	20220
median	31080
Q3	41620
95-th percentile	71650
Maximum	79600
Range	69420
Interquartile range (IQR)	21400

Descriptive statistics

Standard deviation	15208.39888
Coefficient of variation (CV)	0.467743866
Kurtosis	1.142376048
Mean	32514.37376
Median Absolute Deviation (MAD)	10620
Skewness	0.9576739483
Sum	4553670560
Variance	231295396.6
Monotocity	Increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
35620	756	0.5%
16980	741	0.5%
31080	741	0.5%
37980	716	0.5%
71650	715	0.5%
47900	713	0.5%
19100	710	0.5%
26420	704	0.5%
42660	698	0.5%
33100	697	0.5%
Other values (386)	132860	94.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
10180	281	0.2%
10380	176	0.1%
10420	496	0.4%
10500	233	0.2%
10540	239	0.2%

Value	Count	Frequency (%)
79600	485	0.3%
78700	269	0.2%
78100	503	0.4%
77200	598	0.4%
76900	333	0.2%

AREA_TITLE
Categorical

HIGH CARDINALITY

Distinct	396
Distinct (%)	0.3%
Missing	0
Missing (%)	0.0%
Memory size	1.1 MiB

New York-Newark-Jersey City, NY-NJ-PA	756
Los Angeles-Long Beach-Anaheim, CA	741
Chicago-Naperville-Elgin, IL-IN-WI	741
Philadelphia-Camden-Wilmington, PA-NJ-DE-MD	716
Boston-Cambridge-Nashua, MA-NH	715
Other values (391)	136382

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
New York-Newark-Jersey City, NY-NJ-PA	756	0.5%
Los Angeles-Long Beach-Anaheim, CA	741	0.5%
Chicago-Naperville-Elgin, IL-IN-WI	741	0.5%
Philadelphia-Camden-Wilmington, PA-NJ-DE-MD	716	0.5%
Boston-Cambridge-Nashua, MA-NH	715	0.5%
Washington-Arlington-Alexandria, DC-VA-MD-WV	713	0.5%
Dallas-Fort Worth-Arlington, TX	710	0.5%
Houston-The Woodlands-Sugar Land, TX	704	0.5%
Seattle-Tacoma-Bellevue, WA	698	0.5%
Miami-Fort Lauderdale-West Palm Beach, FL	697	0.5%
Other values (386)	132860	94.9%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	46
Median length	17
Mean length	20.13839958
Min length	8

PRIM_STATE
Categorical

HIGH CARDINALITY

Distinct	52
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.1 MiB

CA	10713
TX	9320
FL	8318
PA	6406
NC	5420
Other values (47)	99874

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
CA	10713	7.6%
TX	9320	6.7%
FL	8318	5.9%
PA	6406	4.6%
NC	5420	3.9%
OH	4845	3.5%
NY	4750	3.4%
MI	4432	3.2%
GA	4182	3.0%
WI	4066	2.9%
Other values (42)	77599	55.4%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	2
Median length	2
Mean length	2
Min length	2

OCC_CODE
Real number (ℝ_≥0)

Distinct	808
Distinct (%)	0.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	337441.9448
Minimum	0
Maximum	537199
Zeros	396
Zeros (%)	0.3%
Memory size	1.1 MiB

Quantile statistics

Minimum	0
5-th percentile	119051
Q1	212011
median	339098
Q3	472021
95-th percentile	519198
Maximum	537199
Range	537199
Interquartile range (IQR)	260010

Descriptive statistics

Standard deviation	136456.9079
Coefficient of variation (CV)	0.404386325
Kurtosis	-1.233256796
Mean	337441.9448
Median Absolute Deviation (MAD)	128005
Skewness	-0.1863556408
Sum	4.725908181e+10
Variance	1.862048773e+10
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	396	0.3%
412011	396	0.3%
533032	396	0.3%
412031	396	0.3%
439061	396	0.3%
510000	396	0.3%
411011	396	0.3%
390000	396	0.3%
530000	396	0.3%
353023	396	0.3%
Other values (798)	136091	97.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	396	0.3%
110000	396	0.3%
111011	318	0.2%
111021	396	0.3%
111031	189	0.1%

Value	Count	Frequency (%)
537199	67	< 0.1%
537121	27	< 0.1%
537081	265	0.2%
537073	22	< 0.1%
537072	30	< 0.1%

OCC_TITLE
Categorical

HIGH CARDINALITY

Distinct	808
Distinct (%)	0.6%
Missing	0
Missing (%)	0.0%
Memory size	1.1 MiB

Office and Administrative Support Occupations	396
Construction and Extraction Occupations	396
Maintenance and Repair Workers, General	396
All Occupations	396
First-Line Supervisors of Retail Sales Workers	396
Other values (803)	138071

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
Office and Administrative Support Occupations	396	0.3%
Construction and Extraction Occupations	396	0.3%
Maintenance and Repair Workers, General	396	0.3%
All Occupations	396	0.3%
First-Line Supervisors of Retail Sales Workers	396	0.3%
General and Operations Managers	396	0.3%
Heavy and Tractor-Trailer Truck Drivers	396	0.3%
Office Clerks, General	396	0.3%
Building and Grounds Cleaning and Maintenance Occupations	396	0.3%
Food Preparation and Serving Related Occupations	396	0.3%
Other values (798)	136091	97.2%

Frequencies of value counts

Unique

Unique	6 ?
Unique (%)	< 0.1%

Histogram of lengths of the category

Length

Max length	136
Median length	35
Mean length	37.64073088
Min length	6

O_GROUP
Categorical

Distinct	3
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.1 MiB

detailed	131010
major	8645
total	396

Frequencies
Length

Value	Count	Frequency (%)
detailed	131010	93.5%
major	8645	6.2%
total	396	0.3%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	8
Median length	8
Mean length	7.806334835
Min length	5

TOT_EMP
Real number (ℝ_≥0)

MISSING
SKEWED

Distinct	3807
Distinct (%)	3.0%
Missing	11658
Missing (%)	8.3%
Infinite	0
Infinite (%)	0.0%

Mean	2832.213672
Minimum	30
Maximum	8834370
Zeros	0
Zeros (%)	0.0%
Memory size	1.1 MiB

Quantile statistics

Minimum	30
5-th percentile	40
Q1	90
median	230
Q3	780
95-th percentile	6540
Maximum	8834370
Range	8834340
Interquartile range (IQR)	690

Descriptive statistics

Standard deviation	45868.87764
Coefficient of variation (CV)	16.19541565
Kurtosis	14489.76716
Mean	2832.213672
Median Absolute Deviation (MAD)	180
Skewness	99.04921957
Sum	363636410
Variance	2103953936
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
40	6873	4.9%
50	6078	4.3%
60	5262	3.8%
70	4670	3.3%
80	4359	3.1%
30	4007	2.9%
90	3812	2.7%
100	3409	2.4%
110	3069	2.2%
120	2813	2.0%
Other values (3797)	84041	60.0%
(Missing)	11658	8.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
30	4007	2.9%
40	6873	4.9%
50	6078	4.3%
60	5262	3.8%
70	4670	3.3%

Value	Count	Frequency (%)
8834370	1	< 0.1%
5822510	1	< 0.1%
4362110	1	< 0.1%
3588450	1	< 0.1%
3022200	1	< 0.1%

EMP_PRSE
Real number (ℝ_≥0)

MISSING
ZEROS

Distinct	500
Distinct (%)	0.4%
Missing	11658
Missing (%)	8.3%
Infinite	0
Infinite (%)	0.0%

Mean	18.46889939
Minimum	0
Maximum	49.9
Zeros	2729
Zeros (%)	1.9%
Memory size	1.1 MiB

Quantile statistics

Minimum	0
5-th percentile	2.8
Q1	9.1
median	16
Q3	26.1
95-th percentile	42.2
Maximum	49.9
Range	49.9
Interquartile range (IQR)	17

Descriptive statistics

Standard deviation	11.97463584
Coefficient of variation (CV)	0.6483675928
Kurtosis	-0.3547705279
Mean	18.46889939
Median Absolute Deviation (MAD)	8
Skewness	0.6643197638
Sum	2371277.4
Variance	143.3919036
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	2729	1.9%
8.9	537	0.4%
8.4	529	0.4%
9.6	527	0.4%
10.4	527	0.4%
10.9	526	0.4%
7.9	523	0.4%
11.4	518	0.4%
7.4	513	0.4%
8.7	513	0.4%
Other values (490)	120951	86.4%
(Missing)	11658	8.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	2729	1.9%
0.1	53	< 0.1%
0.2	72	0.1%
0.3	77	0.1%
0.4	75	0.1%

Value	Count	Frequency (%)
49.9	64	< 0.1%
49.8	83	0.1%
49.7	74	0.1%
49.6	68	< 0.1%
49.5	67	< 0.1%

JOBS_1000
Real number (ℝ_≥0)

MISSING

Distinct	21772
Distinct (%)	17.0%
Missing	11658
Missing (%)	8.3%
Infinite	0
Infinite (%)	0.0%

Mean	8.856372217
Minimum	0.004
Maximum	1000
Zeros	0
Zeros (%)	0.0%
Memory size	1.1 MiB

Quantile statistics

Minimum	0.004
5-th percentile	0.131
Q1	0.554
median	1.35
Q3	3.689
95-th percentile	28.5044
Maximum	1000
Range	999.996
Interquartile range (IQR)	3.135

Descriptive statistics

Standard deviation	57.1884465
Coefficient of variation (CV)	6.457321926
Kurtosis	275.4692133
Mean	8.856372217
Median Absolute Deviation (MAD)	1.017
Skewness	16.14843491
Sum	1137096.198
Variance	3270.518413
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1000	396	0.3%
0.224	85	0.1%
0.274	84	0.1%
0.28	83	0.1%
0.555	83	0.1%
0.419	83	0.1%
0.199	83	0.1%
0.149	82	0.1%
0.115	82	0.1%
0.271	81	0.1%
Other values (21762)	127251	90.9%
(Missing)	11658	8.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.004	2	< 0.1%
0.005	3	< 0.1%
0.006	1	< 0.1%
0.007	5	< 0.1%
0.008	6	< 0.1%

Value	Count	Frequency (%)
1000	396	0.3%
359.002	1	< 0.1%
242.405	1	< 0.1%
238.505	1	< 0.1%
233.21	1	< 0.1%

LOC_QUOTIENT
Real number (ℝ_≥0)

MISSING
SKEWED

Distinct	1511
Distinct (%)	1.2%
Missing	11658
Missing (%)	8.3%
Infinite	0
Infinite (%)	0.0%

Mean	1.301940526
Minimum	0.03
Maximum	319.37
Zeros	0
Zeros (%)	0.0%
Memory size	1.1 MiB

Quantile statistics

Minimum	0.03
5-th percentile	0.34
Q1	0.68
median	0.97
Q3	1.38
95-th percentile	2.91
Maximum	319.37
Range	319.34
Interquartile range (IQR)	0.7

Descriptive statistics

Standard deviation	2.446354709
Coefficient of variation (CV)	1.879006498
Kurtosis	3338.29665
Mean	1.301940526
Median Absolute Deviation (MAD)	0.33
Skewness	39.84715828
Sum	167160.05
Variance	5.98465136
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	1459	1.0%
0.8	1178	0.8%
0.83	1141	0.8%
0.82	1141	0.8%
0.91	1137	0.8%
0.84	1125	0.8%
0.87	1118	0.8%
0.94	1115	0.8%
0.79	1112	0.8%
0.86	1111	0.8%
Other values (1501)	116756	83.4%
(Missing)	11658	8.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.03	1	< 0.1%
0.04	9	< 0.1%
0.05	8	< 0.1%
0.06	22	< 0.1%
0.07	20	< 0.1%

Value	Count	Frequency (%)
319.37	1	< 0.1%
218.17	1	< 0.1%
166.24	1	< 0.1%
129.65	1	< 0.1%
115.51	1	< 0.1%

H_MEAN
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	7980
Distinct (%)	6.1%
Missing	9284
Missing (%)	6.6%
Infinite	0
Infinite (%)	0.0%

Mean	27.17055129
Minimum	8.32
Maximum	151.84
Zeros	0
Zeros (%)	0.0%
Memory size	1.1 MiB

Quantile statistics

Minimum	8.32
5-th percentile	12.02
Q1	17.08
median	22.94
Q3	32.59
95-th percentile	55.27
Maximum	151.84
Range	143.52
Interquartile range (IQR)	15.51

Descriptive statistics

Standard deviation	15.45700235
Coefficient of variation (CV)	0.568888065
Kurtosis	9.941217719
Mean	27.17055129
Median Absolute Deviation (MAD)	6.97
Skewness	2.479876637
Sum	3553011.48
Variance	238.9189215
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
16.4	90	0.1%
17.68	86	0.1%
16.56	86	0.1%
17.61	83	0.1%
17.01	81	0.1%
18.15	80	0.1%
16.86	79	0.1%
17.62	79	0.1%
17.29	79	0.1%
18.83	77	0.1%
Other values (7970)	129947	92.8%
(Missing)	9284	6.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
8.32	1	< 0.1%
8.33	2	< 0.1%
8.35	2	< 0.1%
8.38	2	< 0.1%
8.39	2	< 0.1%

Value	Count	Frequency (%)
151.84	1	< 0.1%
151	1	< 0.1%
149.64	1	< 0.1%
148.94	1	< 0.1%
148.1	1	< 0.1%

A_MEAN
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	14142
Distinct (%)	10.3%
Missing	2848
Missing (%)	2.0%
Infinite	0
Infinite (%)	0.0%

Mean	57081.51556
Minimum	17300
Maximum	315830
Zeros	0
Zeros (%)	0.0%
Memory size	1.1 MiB

Quantile statistics

Minimum	17300
5-th percentile	25100
Q1	35860
median	48560
Q3	68900
95-th percentile	115119
Maximum	315830
Range	298530
Interquartile range (IQR)	33040

Descriptive statistics

Standard deviation	32034.06981
Coefficient of variation (CV)	0.5611986559
Kurtosis	9.566794437
Mean	57081.51556
Median Absolute Deviation (MAD)	14950
Skewness	2.408721786
Sum	7831755180
Variance	1026181629
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
37890	47	< 0.1%
39690	47	< 0.1%
34280	46	< 0.1%
36770	46	< 0.1%
37450	45	< 0.1%
42100	45	< 0.1%
34110	45	< 0.1%
36640	45	< 0.1%
33680	44	< 0.1%
35070	44	< 0.1%
Other values (14132)	136749	97.6%
(Missing)	2848	2.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
17300	1	< 0.1%
17330	2	< 0.1%
17360	1	< 0.1%
17370	1	< 0.1%
17430	1	< 0.1%

Value	Count	Frequency (%)
315830	1	< 0.1%
314080	1	< 0.1%
311260	1	< 0.1%
309800	1	< 0.1%
308050	1	< 0.1%

MEAN_PRSE
Real number (ℝ_≥0)

MISSING

Distinct	296
Distinct (%)	0.2%
Missing	2976
Missing (%)	2.1%
Infinite	0
Infinite (%)	0.0%

Mean	5.296913369
Minimum	0.4
Maximum	29.9
Zeros	0
Zeros (%)	0.0%
Memory size	1.1 MiB

Quantile statistics

Minimum	0.4
5-th percentile	1.8
Q1	2.9
median	4.2
Q3	6.4
95-th percentile	12.6
Maximum	29.9
Range	29.5
Interquartile range (IQR)	3.5

Descriptive statistics

Standard deviation	3.659072129
Coefficient of variation (CV)	0.6907932743
Kurtosis	6.98808419
Mean	5.296913369
Median Absolute Deviation (MAD)	1.5
Skewness	2.243364742
Sum	726074.4
Variance	13.38880885
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2.9	2997	2.1%
2.7	2969	2.1%
3	2938	2.1%
3.3	2937	2.1%
3.1	2911	2.1%
2.6	2908	2.1%
3.2	2901	2.1%
3.5	2896	2.1%
2.8	2879	2.1%
3.4	2872	2.1%
Other values (286)	107867	77.0%
(Missing)	2976	2.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.4	2	< 0.1%
0.5	10	< 0.1%
0.6	33	< 0.1%
0.7	41	< 0.1%
0.8	70	< 0.1%

Value	Count	Frequency (%)
29.9	3	< 0.1%
29.8	7	< 0.1%
29.7	7	< 0.1%
29.6	2	< 0.1%
29.5	5	< 0.1%

H_PCT10
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	4985
Distinct (%)	3.8%
Missing	9305
Missing (%)	6.6%
Infinite	0
Infinite (%)	0.0%

Mean	16.91676013
Minimum	7.25
Maximum	99.86
Zeros	0
Zeros (%)	0.0%
Memory size	1.1 MiB

Quantile statistics

Minimum	7.25
5-th percentile	8.51
Q1	11.58
median	14.43
Q3	19.79
95-th percentile	32.9
Maximum	99.86
Range	92.61
Interquartile range (IQR)	8.21

Descriptive statistics

Standard deviation	8.584591168
Coefficient of variation (CV)	0.5074607136
Kurtosis	12.74854636
Mean	16.91676013
Median Absolute Deviation (MAD)	3.69
Skewness	2.706131864
Sum	2211798.72
Variance	73.69520553
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
13.02	988	0.7%
13.01	947	0.7%
13.52	309	0.2%
12.77	268	0.2%
18.15	260	0.2%
13.51	255	0.2%
10	254	0.2%
10.01	238	0.2%
18.56	227	0.2%
12.76	210	0.1%
Other values (4975)	126790	90.5%
(Missing)	9305	6.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
7.25	1	< 0.1%
7.26	1	< 0.1%
7.32	1	< 0.1%
7.33	1	< 0.1%
7.38	1	< 0.1%

Value	Count	Frequency (%)
99.86	1	< 0.1%
99.79	1	< 0.1%
99.6	1	< 0.1%
99.59	1	< 0.1%
99.37	1	< 0.1%

H_PCT25
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	5967
Distinct (%)	4.6%
Missing	9543
Missing (%)	6.8%
Infinite	0
Infinite (%)	0.0%

Mean	20.33493548
Minimum	7.26
Maximum	99.92
Zeros	0
Zeros (%)	0.0%
Memory size	1.1 MiB

Quantile statistics

Minimum	7.26
5-th percentile	9.51
Q1	13.34
median	17.32
Q3	24.23
95-th percentile	40.59
Maximum	99.92
Range	92.66
Interquartile range (IQR)	10.89

Descriptive statistics

Standard deviation	10.63222575
Coefficient of variation (CV)	0.5228551504
Kurtosis	8.1721768
Mean	20.33493548
Median Absolute Deviation (MAD)	4.78
Skewness	2.244842299
Sum	2653871.76
Variance	113.0442244
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
13.02	672	0.5%
18.57	346	0.2%
18.16	262	0.2%
13.52	192	0.1%
13.01	170	0.1%
10.01	139	0.1%
13.51	127	0.1%
12.01	120	0.1%
11.01	120	0.1%
15.01	120	0.1%
Other values (5957)	128240	91.6%
(Missing)	9543	6.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
7.26	1	< 0.1%
7.82	1	< 0.1%
7.83	3	< 0.1%
7.84	1	< 0.1%
7.85	2	< 0.1%

Value	Count	Frequency (%)
99.92	1	< 0.1%
99.9	1	< 0.1%
99.89	1	< 0.1%
99.88	1	< 0.1%
99.84	1	< 0.1%

H_MEDIAN
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	6812
Distinct (%)	5.2%
Missing	10152
Missing (%)	7.2%
Infinite	0
Infinite (%)	0.0%

Mean	25.05029746
Minimum	8.01
Maximum	99.99
Zeros	0
Zeros (%)	0.0%
Memory size	1.1 MiB

Quantile statistics

Minimum	8.01
5-th percentile	11.169
Q1	15.99
median	21.69
Q3	30.46
95-th percentile	50.36
Maximum	99.99
Range	91.98
Interquartile range (IQR)	14.47

Descriptive statistics

Standard deviation	12.78164494
Coefficient of variation (CV)	0.5102392479
Kurtosis	3.646514873
Mean	25.05029746
Median Absolute Deviation (MAD)	6.72
Skewness	1.62257236
Sum	3254008.59
Variance	163.3704473
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
13.02	151	0.1%
14.37	95	0.1%
19.21	95	0.1%
17.91	93	0.1%
17.42	92	0.1%
17.66	91	0.1%
18.97	90	0.1%
18.51	88	0.1%
14.74	87	0.1%
18.23	87	0.1%
Other values (6802)	128930	92.1%
(Missing)	10152	7.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
8.01	1	< 0.1%
8.33	3	< 0.1%
8.35	1	< 0.1%
8.36	1	< 0.1%
8.38	2	< 0.1%

Value	Count	Frequency (%)
99.99	1	< 0.1%
99.97	1	< 0.1%
99.79	1	< 0.1%
99.78	1	< 0.1%
99.75	1	< 0.1%

H_PCT75
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	7955
Distinct (%)	6.2%
Missing	10932
Missing (%)	7.8%
Infinite	0
Infinite (%)	0.0%

Mean	31.01998033
Minimum	8.84
Maximum	99.96
Zeros	0
Zeros (%)	0.0%
Memory size	1.1 MiB

Quantile statistics

Minimum	8.84
5-th percentile	13.17
Q1	19.37
median	27.13
Q3	38.48
95-th percentile	63.01
Maximum	99.96
Range	91.12
Interquartile range (IQR)	19.11

Descriptive statistics

Standard deviation	15.58891126
Coefficient of variation (CV)	0.502544202
Kurtosis	1.570378605
Mean	31.01998033
Median Absolute Deviation (MAD)	8.74
Skewness	1.26801699
Sum	4005268.84
Variance	243.0141543
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
31.27	298	0.2%
30.29	250	0.2%
30.28	217	0.2%
31.26	131	0.1%
18.98	101	0.1%
19.05	87	0.1%
18.47	84	0.1%
19.1	79	0.1%
18.97	78	0.1%
18.82	77	0.1%
Other values (7945)	127717	91.2%
(Missing)	10932	7.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
8.84	3	< 0.1%
8.86	2	< 0.1%
8.89	1	< 0.1%
8.9	1	< 0.1%
8.91	1	< 0.1%

Value	Count	Frequency (%)
99.96	1	< 0.1%
99.95	1	< 0.1%
99.93	2	< 0.1%
99.86	1	< 0.1%
99.84	1	< 0.1%

H_PCT90
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	8738
Distinct (%)	6.9%
Missing	13146
Missing (%)	9.4%
Infinite	0
Infinite (%)	0.0%

Mean	37.07292053
Minimum	9.14
Maximum	99.99
Zeros	0
Zeros (%)	0.0%
Memory size	1.1 MiB

Quantile statistics

Minimum	9.14
5-th percentile	15.36
Q1	23.82
median	31.77
Q3	47.12
95-th percentile	75.87
Maximum	99.99
Range	90.85
Interquartile range (IQR)	23.3

Descriptive statistics

Standard deviation	18.21480777
Coefficient of variation (CV)	0.4913237887
Kurtosis	0.7261387311
Mean	37.07292053
Median Absolute Deviation (MAD)	10.01
Skewness	1.080225904
Sum	4704738.98
Variance	331.7792222
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
30.29	261	0.2%
30.89	189	0.1%
30.9	159	0.1%
31.27	114	0.1%
24.96	92	0.1%
31.93	83	0.1%
31.49	77	0.1%
24.15	74	0.1%
24.33	74	0.1%
19.51	74	0.1%
Other values (8728)	125708	89.8%
(Missing)	13146	9.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
9.14	3	< 0.1%
9.16	1	< 0.1%
9.17	1	< 0.1%
9.21	2	< 0.1%
9.22	1	< 0.1%

Value	Count	Frequency (%)
99.99	1	< 0.1%
99.98	1	< 0.1%
99.97	1	< 0.1%
99.96	3	< 0.1%
99.93	1	< 0.1%

A_PCT10
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	8808
Distinct (%)	6.4%
Missing	2869
Missing (%)	2.0%
Infinite	0
Infinite (%)	0.0%

Mean	35433.15041
Minimum	15090
Maximum	207720
Zeros	0
Zeros (%)	0.0%
Memory size	1.1 MiB

Quantile statistics

Minimum	15090
5-th percentile	17690
Q1	24210
median	30470
Q3	41810
95-th percentile	68370
Maximum	207720
Range	192630
Interquartile range (IQR)	17600

Descriptive statistics

Standard deviation	17779.05596
Coefficient of variation (CV)	0.5017633417
Kurtosis	12.28425129
Mean	35433.15041
Median Absolute Deviation (MAD)	8000
Skewness	2.624782092
Sum	4860790440
Variance	316094830.8
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
27070	1184	0.8%
27080	563	0.4%
37760	282	0.2%
28110	252	0.2%
20810	235	0.2%
38610	217	0.2%
26550	197	0.1%
28120	165	0.1%
24970	151	0.1%
22890	142	0.1%
Other values (8798)	133794	95.5%
(Missing)	2869	2.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
15090	2	< 0.1%
15240	2	< 0.1%
15350	1	< 0.1%
15570	2	< 0.1%
15590	1	< 0.1%

Value	Count	Frequency (%)
207720	1	< 0.1%
207570	1	< 0.1%
207180	1	< 0.1%
207150	1	< 0.1%
206700	1	< 0.1%

A_PCT25
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	10634
Distinct (%)	7.8%
Missing	3108
Missing (%)	2.2%
Infinite	0
Infinite (%)	0.0%

Mean	42665.57064
Minimum	15100
Maximum	207840
Zeros	0
Zeros (%)	0.0%
Memory size	1.1 MiB

Quantile statistics

Minimum	15100
5-th percentile	19770
Q1	27890
median	36540
Q3	51450
95-th percentile	84410
Maximum	207840
Range	192740
Interquartile range (IQR)	23560

Descriptive statistics

Standard deviation	22052.00814
Coefficient of variation (CV)	0.5168572179
Kurtosis	7.825277821
Mean	42665.57064
Median Absolute Deviation (MAD)	10330
Skewness	2.17129169
Sum	5842751240
Variance	486291063.1
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
27080	417	0.3%
27070	325	0.2%
38620	310	0.2%
37770	202	0.1%
28120	111	0.1%
20810	105	0.1%
28110	99	0.1%
20820	82	0.1%
37760	78	0.1%
24970	70	< 0.1%
Other values (10624)	135144	96.5%
(Missing)	3108	2.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
15100	1	< 0.1%
16270	1	< 0.1%
16280	2	< 0.1%
16290	1	< 0.1%
16320	2	< 0.1%

Value	Count	Frequency (%)
207840	1	< 0.1%
207800	1	< 0.1%
207760	1	< 0.1%
207740	1	< 0.1%
207680	1	< 0.1%

A_MEDIAN
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	12568
Distinct (%)	9.2%
Missing	3723
Missing (%)	2.7%
Infinite	0
Infinite (%)	0.0%

Mean	52678.29844
Minimum	16660
Maximum	207980
Zeros	0
Zeros (%)	0.0%
Memory size	1.1 MiB

Quantile statistics

Minimum	16660
5-th percentile	23260
Q1	33620
median	45950
Q3	64320
95-th percentile	105046.5
Maximum	207980
Range	191320
Interquartile range (IQR)	30700

Descriptive statistics

Standard deviation	26641.40816
Coefficient of variation (CV)	0.5057378265
Kurtosis	3.419860842
Mean	52678.29844
Median Absolute Deviation (MAD)	14450
Skewness	1.563209933
Sum	7181527070
Variance	709764628.7
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
27080	123	0.1%
39950	57	< 0.1%
30650	54	< 0.1%
48200	54	< 0.1%
48930	54	< 0.1%
51160	52	< 0.1%
50720	51	< 0.1%
34920	50	< 0.1%
29890	50	< 0.1%
37930	50	< 0.1%
Other values (12558)	135733	96.9%
(Missing)	3723	2.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
16660	1	< 0.1%
17330	3	< 0.1%
17370	1	< 0.1%
17380	1	< 0.1%
17420	1	< 0.1%

Value	Count	Frequency (%)
207980	1	< 0.1%
207930	1	< 0.1%
207550	1	< 0.1%
207540	1	< 0.1%
207480	1	< 0.1%

A_PCT75
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	15065
Distinct (%)	11.1%
Missing	4546
Missing (%)	3.2%
Infinite	0
Infinite (%)	0.0%

Mean	65320.53799
Minimum	18380
Maximum	207930
Zeros	0
Zeros (%)	0.0%
Memory size	1.1 MiB

Quantile statistics

Minimum	18380
5-th percentile	27580
Q1	40630
median	57690
Q3	81080
95-th percentile	131690
Maximum	207930
Range	189550
Interquartile range (IQR)	40450

Descriptive statistics

Standard deviation	32615.86012
Coefficient of variation (CV)	0.4993201392
Kurtosis	1.450675621
Mean	65320.53799
Median Absolute Deviation (MAD)	18860
Skewness	1.226531163
Sum	8851259500
Variance	1063794331
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
65030	276	0.2%
62990	221	0.2%
63000	173	0.1%
65040	108	0.1%
83210	53	< 0.1%
39480	52	< 0.1%
62980	47	< 0.1%
84400	46	< 0.1%
39630	45	< 0.1%
47580	45	< 0.1%
Other values (15055)	134439	96.0%
(Missing)	4546	3.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
18380	3	< 0.1%
18420	1	< 0.1%
18430	1	< 0.1%
18500	1	< 0.1%
18510	1	< 0.1%

Value	Count	Frequency (%)
207930	1	< 0.1%
207900	1	< 0.1%
207860	1	< 0.1%
207850	2	< 0.1%
207710	1	< 0.1%

A_PCT90
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	16939
Distinct (%)	12.7%
Missing	6956
Missing (%)	5.0%
Infinite	0
Infinite (%)	0.0%

Mean	78065.96003
Minimum	19010
Maximum	207980
Zeros	0
Zeros (%)	0.0%
Memory size	1.1 MiB

Quantile statistics

Minimum	19010
5-th percentile	32040
Q1	49980
median	67090
Q3	99510
95-th percentile	158710
Maximum	207980
Range	188970
Interquartile range (IQR)	49530

Descriptive statistics

Standard deviation	38144.70468
Coefficient of variation (CV)	0.4886214768
Kurtosis	0.6342443799
Mean	78065.96003
Median Absolute Deviation (MAD)	21350
Skewness	1.044247294
Sum	1.039018895e+10
Variance	1455018495
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
63000	223	0.2%
64260	176	0.1%
65040	94	0.1%
64270	83	0.1%
64250	58	< 0.1%
66410	58	< 0.1%
51910	57	< 0.1%
99740	57	< 0.1%
99750	57	< 0.1%
62990	50	< 0.1%
Other values (16929)	132182	94.4%
(Missing)	6956	5.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
19010	2	< 0.1%
19020	1	< 0.1%
19060	2	< 0.1%
19150	2	< 0.1%
19180	1	< 0.1%

Value	Count	Frequency (%)
207980	1	< 0.1%
207970	1	< 0.1%
207960	1	< 0.1%
207940	1	< 0.1%
207920	2	< 0.1%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

First rows

	AREA	AREA_TITLE	PRIM_STATE	OCC_CODE	OCC_TITLE	O_GROUP	TOT_EMP	EMP_PRSE	JOBS_1000	LOC_QUOTIENT	H_MEAN	A_MEAN	MEAN_PRSE	H_PCT10	H_PCT25	H_MEDIAN	H_PCT75	H_PCT90	A_PCT10	A_PCT25	A_MEDIAN	A_PCT75	A_PCT90
0	10180	Abilene, TX	TX	0	All Occupations	total	66060.0	1.9	1000.000	1.00	20.64	42930.0	1.8	9.13	11.40	16.41	24.82	36.23	18990.0	23710.0	34130.0	51620.0	75370.0
1	10180	Abilene, TX	TX	110000	Management Occupations	major	2910.0	4.5	44.068	0.77	42.87	89160.0	2.2	17.38	26.74	36.37	51.68	73.88	36150.0	55620.0	75640.0	107500.0	153670.0
2	10180	Abilene, TX	TX	111021	General and Operations Managers	detailed	1320.0	7.4	20.036	1.19	40.38	83990.0	3.5	12.67	24.02	32.96	50.11	72.93	26350.0	49960.0	68550.0	104230.0	151700.0
3	10180	Abilene, TX	TX	112022	Sales Managers	detailed	90.0	18.5	1.317	0.47	58.18	121020.0	7.6	26.23	35.90	52.41	68.01	NaN	54560.0	74680.0	109000.0	141460.0	NaN
4	10180	Abilene, TX	TX	112030	Public Relations and Fundraising Managers	detailed	40.0	31.5	0.549	0.94	45.93	95540.0	20.7	28.71	32.78	36.24	41.23	83.81	59710.0	68180.0	75380.0	85760.0	174320.0
5	10180	Abilene, TX	TX	113010	Administrative Services and Facilities Managers	detailed	140.0	12.3	2.045	0.92	37.79	78600.0	3.5	24.93	28.28	35.06	45.45	55.25	51850.0	58820.0	72920.0	94530.0	114920.0
6	10180	Abilene, TX	TX	113021	Computer and Information Systems Managers	detailed	70.0	30.2	1.054	0.32	59.15	123040.0	8.5	26.29	35.72	56.28	71.04	97.75	54690.0	74310.0	117060.0	147760.0	203330.0
7	10180	Abilene, TX	TX	113031	Financial Managers	detailed	120.0	8.8	1.883	0.40	57.49	119580.0	9.6	25.74	34.93	46.19	62.85	NaN	53540.0	72650.0	96080.0	130730.0	NaN
8	10180	Abilene, TX	TX	113051	Industrial Production Managers	detailed	50.0	22.3	0.761	0.59	54.65	113680.0	12.0	29.20	36.76	47.44	64.49	84.92	60730.0	76460.0	98680.0	134140.0	176630.0
9	10180	Abilene, TX	TX	113071	Transportation, Storage, and Distribution Managers	detailed	60.0	18.6	0.890	0.94	40.88	85030.0	3.8	30.53	34.41	39.63	47.38	51.38	63500.0	71580.0	82430.0	98550.0	106880.0

Last rows

	AREA	AREA_TITLE	PRIM_STATE	OCC_CODE	OCC_TITLE	O_GROUP	TOT_EMP	EMP_PRSE	JOBS_1000	LOC_QUOTIENT	H_MEAN	A_MEAN	MEAN_PRSE	H_PCT10	H_PCT25	H_MEDIAN	H_PCT75	H_PCT90	A_PCT10	A_PCT25	A_MEDIAN	A_PCT75	A_PCT90
140041	79600	Worcester, MA-CT	MA	536031	Automotive and Watercraft Service Attendants	detailed	40.0	22.6	0.138	0.17	14.50	30160.0	2.8	12.97	13.48	14.34	15.20	16.64	26970.0	28050.0	29830.0	31620.0	34620.0
140042	79600	Worcester, MA-CT	MA	536051	Transportation Inspectors	detailed	NaN	NaN	NaN	NaN	25.83	53720.0	13.7	13.44	14.44	19.72	31.72	41.53	27950.0	30030.0	41010.0	65980.0	86370.0
140043	79600	Worcester, MA-CT	MA	537051	Industrial Truck and Tractor Operators	detailed	1280.0	7.9	4.796	1.04	17.98	37400.0	2.9	13.74	15.09	17.54	20.14	23.84	28580.0	31380.0	36490.0	41890.0	49580.0
140044	79600	Worcester, MA-CT	MA	537061	Cleaners of Vehicles and Equipment	detailed	280.0	15.8	1.056	0.43	16.73	34790.0	5.0	12.77	12.92	14.87	19.59	23.75	26550.0	26870.0	30920.0	40750.0	49390.0
140045	79600	Worcester, MA-CT	MA	537062	Laborers and Freight, Stock, and Material Movers, Hand	detailed	4770.0	7.8	17.944	0.89	16.52	34360.0	1.7	12.87	13.43	14.91	18.41	22.96	26780.0	27930.0	31000.0	38290.0	47760.0
140046	79600	Worcester, MA-CT	MA	537063	Machine Feeders and Offbearers	detailed	180.0	17.5	0.660	1.43	17.57	36540.0	5.1	13.35	14.31	16.11	20.42	24.29	27770.0	29770.0	33500.0	42470.0	50530.0
140047	79600	Worcester, MA-CT	MA	537064	Packers and Packagers, Hand	detailed	1220.0	21.6	4.592	1.07	15.68	32620.0	2.4	12.87	13.42	14.68	16.60	19.62	26780.0	27910.0	30540.0	34530.0	40800.0
140048	79600	Worcester, MA-CT	MA	537065	Stockers and Order Fillers	detailed	4300.0	4.5	16.161	1.02	16.40	34100.0	1.2	12.89	13.65	14.99	18.13	22.65	26810.0	28400.0	31170.0	37700.0	47100.0
140049	79600	Worcester, MA-CT	MA	537081	Refuse and Recyclable Material Collectors	detailed	100.0	16.6	0.388	0.45	22.05	45870.0	4.9	13.41	15.67	22.92	27.45	30.28	27900.0	32580.0	47680.0	57090.0	62980.0
140050	79600	Worcester, MA-CT	MA	537199	Material Moving Workers, All Other	detailed	NaN	NaN	NaN	NaN	23.92	49760.0	4.2	20.68	21.69	23.37	25.05	29.28	43010.0	45110.0	48600.0	52100.0	60910.0

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample

First rows

Last rows